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Abstract 

Introduction: Many studies have investigated the usefulness of cytokeratin 19 frag- 
ments (CYFRA 21-1) in pleural fluid for the differential diagnosis of benign (BPE) 
and malignant pleural (MPE) effusions. In the present meta-analysis, the reported 
studies on the diagnosis between CYFRA 21-1 and pleural effusion were assessed 
to summarize the diagnostic characteristics of CYFRA 21-1 in Chinese patients. 
Material and methods: The data sources from the creation of each database up to 
January 2011 included Medline, Chinese National Knowledge Infrastructure, EMBASE, 
Cochrane Library, and bibliographies of review and original articles. Through a sys- 
tematic literature search for publications, the data from 22 studies were summa- 
rized based on their discussions on the result of the CYFRA 21-1 assay in pleural 
effusion and differential diagnosis evaluation in the Chinese population. 
Results: A total of 22 studies were available for analysis, and the high CYFRA 21-1 
level in MPE was significantly associated with risk for lung cancer (standardized 
mean difference [SMD] = 1.65, 95% confidence interval [CI] = 1.48-1.82, Z = 18.97, 
p < 0.00001) compared with BPE. The CYFRA 21-1 level in pleural effusion (13 stud- 
ies) was significantly higher than that in serum (SMD = 1.10, 95% CI = 0.71-1.48, 
Z = 5.59, p < 0.00001). The risk for squamous cell carcinoma (SCC) for CYFRA 21-1 
was 1.03 (95% CI = 0.64-1.42, Z = 5.15, p < 0.00001) compared with that of ade- 
nocarcinoma (8 studies). The sensitivity of CYFRA 21-1 reported in the articles ranged 
from 46% to 94%, and the specificity ranged from 57% to 100%. The summary 
measure of the test characteristics derived from the summary receiver operating 
characteristic curve was 81% for both sensitivity and specificity (17 studies). 
Conclusions: The measurement of pleural CYFRA 21-1 is likely to be a useful 
diagnostic tool for the confirmation of MPE. 

Keywords: meta-analysis, CYFRA 21-1, pleural effusion, lung cancer, differential diag- 
nosis, tumor marker. 



Introduction 

At the beginning of the 21 st century, lung cancer has emerged as one 
of the world's leading causes of mortality [1]. Although this malignancy 
has been extensively investigated in many fields such as etiology, patho- 
genesis, and therapeutics, there are still unresolved issues with regard to 
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the diagnosis and therapy of this disease that are 
intimately correlated with prognosis of patients. 
Early-stage lung cancer has a better 5-year survival 
rate compared with cancer diagnosed at a later 
stage [2]. Delayed diagnosis of lung cancer leads to 
a high mortality and a dismal treatment outcome. 
Early diagnosis remains a challenge, and the current 
research focuses on whether lung cancer-specific 
molecular alterations can be used as diagnostic sig- 
nals for the determination of this disease [3]. A com- 
mon belief is that the earlier the cancer is detect- 
ed, the better is the probability of reduced mortality 
and morbidity. The advent of new and emerging 
molecular, genetic, and imaging technologies has 
broadened the possible strategies for early detection 
and prevention, but the beneficial impact of these 
methods on mortality must be supported by clini- 
cal evidence. Molecular markers are being identified 
as beneficial in enhancing the present ability to pre- 
dict and detect cancer before the disease progress- 
es as well as detect the earliest signs of impending 
carcinogenic transformation [4, 5]. Biological markers 
are urgently needed to improve the early detection, 
diagnosis, and treatment of lung tumors. Over the 
past several years, various promising biomarkers have 
emerged in the field of lung cancer. 

Cytokeratin 19 fragments (CYFRA 21-1) proved to 
be sensitive and valuable biomarkers for estima- 
tion of diagnosis, prognosis, and therapy monitor- 
ing of lung cancer [6-11]. The CYFRA 21-1 assay is 
a test that has been developed for the detection of 
CYFRA 21-1 in serum, especially in patients with 
non-small cell lung cancer (N5CLC) [12]. However, 
reports on pleural effusion in Asian populations are 
relatively limited. Several studies have investigat- 
ed the diagnostic evaluation between CYFRA 21-1 
level and pleural effusion on cancer epidemiology 
in Chinese patients. Thus, a medical review of lit- 
erature was performed, and a meta-analysis was 
conducted to estimate the magnitude of the asso- 
ciation between CYFRA 21-1 level and lung cancer 
risk in Chinese patients. 

Material and methods 

Identification and eligibility of relevant studies 

Published scientific literature in the databases of 
Medline, Chinese National Knowledge Infrastruc- 
ture, EMBASE, and Cochrane Library were searched 
using free text and various medical subject heading 
terms, such as "pleural effusion", "hydrothorax", 
"CYFRA 21-1", "tumor marker", "lung cancer", "cyto- 
keratin 19", and "pulmonary tuberculosis". The search 
period was from the start of each database up to 
January 2011, and no language restrictions were 
added. Moreover, the bibliographical references of 
the selected articles and the review articles were 
manually revised. The papers must be case-control 



or cohort association studies of the CYFRA 21-1 le- 
vels in pleural effusion in Chinese patients. The 
authors of these studies must have provided the 
sample size, test results (M ± SD), and information 
that can help infer the results in the papers. Aside 
from the database search, papers were also iden- 
tified by a hand screen from the lists of references 
of the selected papers and by personally commu- 
nicating with the authors via e-mail and telephone, 
if necessary. The search and selection of data were 
conducted from March 2010 to January 2011. 

Data extraction 

To avoid bias and improve reliability of the pre- 
sent research, two investigators extracted data 
independently and reached a consensus on all 
items. When the two abstractors did not agree, 
another expert was invited to discuss the disputed 
data, and two consistent opinions were adopted. 
The following data were extracted from each arti- 
cle: first author, date on which the study was pub- 
lished, journal name, the exact data of the total and 
practical number in case and control groups as well 
as the test results. The present research was aimed 
at identifying all trials that reported on the meas- 
urement of CYFRA 21-1 levels and investigated be- 
nign pleural effusion (BPE) in comparison with 
malignant pleural effusion (MPE). All studies includ- 
ed in the meta-analysis were unique contributions. 
If a researcher had published more than one study 
or if results concerning similar populations were 
reported several times, then the other studies would 
be included only if all study populations were inde- 
pendent. All studies underwent an extensive, diag- 
nostic workup to determine the etiology of pleural 
effusion. The exclusion criteria were as follows: (1) 
not original research (reviews, editorials, and non- 
research letters), (2) studies not conducted on hu- 
mans, (3) studies involving patients who had received 
chemotherapy, and (4) studies that did not use a con- 
trol group. The methodological quality of the stud- 
ies was assessed using the guidelines published by 
the standards for reporting of diagnostic accuracy 
(STARD, maximum score 25) initiative [13], which 
set guidelines that aim to improve the quality of 
reporting in diagnostic studies, and the quality 
assessment for studies of diagnostic accuracy 
(QUADAS, maximum score 14) tool [14], in which 
appraisal is performed by empirical evidence, expert 
opinion, and formal consensus on assessing the 
quality of primary studies of diagnostic accuracy. 
Two reviewers also assessed independently the 
methodological quality of the studies. The outcome 
variables were extracted from the BPE and MPE 
groups. When several measures were reported in 
the same study, the one with the acknowledged 
measurement was selected. If the study provided 
stratum information, the data from all strata were 
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collated to utilize the data fully. Studies were inclu- 
ded in the meta-analysis if they provided both the 
sensitivity and specificity of pleural CYFRA 21-1 le- 
vels for the diagnosis, or when CYFRA 21-1 values 
were provided in a scatter plot form. This step facil- 
itated the extraction of test results for individual 
study subjects. From the selected reports, data were 
abstracted in duplicate using a standardized form. 

Statistical analysis 

For the CYFRA 21-1 levels, mean and standard 
deviation (SD) were extracted or derived using the 
data reported. To analyze the differences between 
BPE and MPE, two different approaches were used, 
namely, fixed-effect and random-effect models. 
A fixed-effect model was first performed, assuming 
a uniform homogeneity of the effect size across all 
studies. This step was followed by a random-effect 
model under the assumption of heterogeneity 
between studies. Both within- and between-study 
variabilities were considered in the random-effect 
model, and the effect size was assumed to be drawn 
from a distribution of the standardized mean diffe- 
rence (SMD). Finally, SMD and their 95% confidence 
intervals (CIs) were presented. The x 2 and Fisher's 
exact tests were used to detect statistically signif- 
icant heterogeneity. Heterogeneity was also quan- 
tified with the I 2 statistic, which describes the pro- 
portion of the total variation in study estimates 
caused by heterogeneity. Sensitivity was analyzed 
by omitting each study from the estimated pool at 
every step. Finally, publication bias was evaluated 
using funnel plots [15]. Statistical analyses were 
conducted using Review Manager (version 5, The 
Cochrane Collaboration). Standard methods rec- 
ommended for meta-analyses of diagnostic test 
evaluations were used. Analyses were performed 
using Stata version 10.0 (Stata Corporation, College 
Station, TX, USA) and Meta-DiSc (Meta-DiSc for 



Identified references 



Windows, XI Cochrane Colloquium, Barcelona, 
Spain, 2003). The following measures of test accu- 
racy were computed for each study: sensitivity, 
specificity, positive likelihood ratio (PLR), negative 
likelihood ratio (NLR), and diagnostic odds ratio 
(DOR). Analysis was based on a summary receiver 
operating characteristic (SROC) curve. The sensi- 
tivity and specificity for the single test threshold 
identified for each study were used to plot an SROC 
curve. A random-effect model was used to calculate 
the average sensitivity, specificity, and other meas- 
ures across studies. All tests were two-sided, and 
the significant level was set at 0.05. 

Results 

Description of the studies 

A meta-analysis database was established 
according to the extracted information from each 
selected paper. Table I lists all essential information 
such as the publication year, first author, the num- 
ber of cases (lung cancers), and measure outcomes. 
Initially, 367 studies were identified, and 128 were 
case-control studies, in which 22 studies fulfilled 
the inclusion criteria (Figure 1). The sample sizes 
varied between 60 [16] and 289 [36] patients, and 
the subjects fulfilled a wide range of inclusion crite- 
ria: adolescents [28], adults, and the elderly [19-30]. 
The eligible studies included a total of 1653 MPE 
cases and 1011 BPE controls. The diagnostic criteria 
defined in each study were consistent. Studies on 
the histopathology of the pleural biopsy, pleural 
biopsy specimens, and pathological diagnosis were 
used as gold standards in all reports. The BPE was 
involved in non-cancerous effusion, which was 
induced by other factors such as tuberculosis, heart 
failure, renal failure, and rheumatic diseases. There 
were 5 case-control studies that focused on CYFRA 
21-1 level as determined by ELISA, whereas seven 
and ten case-control studies used immunoradio- 
metric assay (IRMA) and electrochemiluminescence 
assay (ECLA), respectively (Table I). 



References excluded 
(n = 238) 

No original studies 
Non-human studies 



Potentially relevant articles identified for further 



References excluded (n = 106): 

• Combination of other group factors: 38 

• Non-control group: 12 

• The poor quality of references: 56 



Final included: 22 



Figure 1. Study selection algorithm 



Test of heterogeneity 

A more common method of indicating the extent 
of heterogeneity is by a statistical test, often descri- 
bed as Cochran's x 2 test or the Q-test. A p-value is 
frequently quoted as an indication of the extent of 
between-study variability. The heterogeneity for all 
22 case-control studies and the test value of x 2 were 
analyzed. At first, if the heterogeneity of the studies 
is considered acceptable, the fixed-effect model and 
weighted mean difference were used. The % 2 value 
for the heterogeneity of the 22 case-control stud- 
ies was 161.18 with 21 degrees of freedom (d/) and 
p < 0.001. Another index for the heterogeneity test 
is the I 2 value. The I 2 value describes the percen- 
tage of variability in point estimates caused by he- 
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Table L Description of the included studies 



Author, year 


Average age [years] 
Benign/malignant 


Gender 


Hydrothorax group 


Quality score 


Assay 




F/M 


Benign 


Malignant 


STARD 


QUADAS 




Yijiang, 1999 [16] 


33/53 


28/32 


30 


30 


11 


9 


ELISA 


Xiaofu, 1999 [19] 




46/62 


40 


68 


5 


5 


IRMA 


Huoqiang, 2002 [17] 






123 


156 


5 


7 


IRMA 


Aizhen, 2003 [31] 






38 


62 


6 


7 


IRMA 


Jianguo, 2003 [32] 


36.4/68.7 


46/130 


69 


107 


16 


12 


EC LA 


Wenfu, 2004 [33] 


46/54 


38/44 


42 


40 


8 


6 


IRMA 


Yalin, 2006 [20] 




30/32 


30 


32 


9 


8 


IRMA 


Yuseng, 2006 [21] 


59.2/60.5 


36/58 


31 


63 


11 


8 


EC LA 


Zikun, 2008 [22] 


42/60 


95/155 


80 


170 


16 


11 


ELISA 


Lianzhou, 2008 [34] 


32/57 


17/31 


18 


30 


9 


6 


EC LA 


Jiahe, 2008 [23] 


49.4/63.7 


21/35 


20 


36 


11 


8 


EC LA 


Baoxiang, 2008 [24] 


60/63 


39/50 


35 


54 


16 


9 


IRMA 


Xilin, 2008 [25] 


39/65 


28/48 


34 


42 


10 


8 


ELISA 


Guochen, 2008 [26] 


68.5 


21/43 


30 


34 


15 


11 


IRMA 


Fang, 2008 [27] 


60/62 


45/78 


45 


78 


11 


9 


EC LA 


Jin, 2009 [18] 


43.9/54.6 


48/59 


48 


59 


17 


14 


ELISA 


Jing, 2009 [28] 




24/56 


40 


40 


11 


8 


ECLA 


Yang, 2010 [29] 




24/69 


28 


65 


7 


9 


ECLA 


Hua, 2010 [30] 


58/61 


59/79 


52 


86 


6 


10 


ECLA 


Hongmei, 2010 [35] 


57.5/59.5 


48/82 


50 


80 


15 


12 


ELISA 


Tian, 2010 [36] 


54.6 


116/212 


36 


253 


13 


10 


ECLA 


Feng, 2010 [37] 


52.1/59.3 


59/101 


84 


76 


10 


9 


ECLA 



F- female, M - male, STARD - standards for reporting diagnostic accuracy (maximum score 25), QUADAS - quality assessment for studies 
of diagnostic accuracy (maximum score 14), IRMA - immunoradimetric assay, ELISA - enzyme-linked immunosorbent assay, ECLA - electro- 
chemiluminescence assay 



terogeneity rather than sampling error. This value 
may be readily calculated from most published 
meta-analyses, and a closed form uncertainty inter- 
val is available. If the I 2 value is lower than 50%, the 
heterogeneity of the studies is considered accept- 
able. The I 2 values were 78% in the first-time analy- 
sis in the present study, and both x 2 and I 2 suggest 
the existence of heterogeneity of the studies. All 
studies were carefully reviewed, and the hetero- 
geneity was considered to be derived basically from 
different assay methods (IRMA, ELISA, and ECLA) 
and measurement units. All included studies exhi- 
bited good clinical homogeneity, considering that 
clinical homogeneity is critical to the meta-analy- 
sis of clinical research. Finally, to reach a credible 
conclusion, the random-effect model and SMD were 
selected to perform the meta-analysis. The random- 
effect model assumes that the studies included in 
the meta-analysis are a random sample of a hypo- 
thetical population and demonstrate within- and 
between-study variabilities. 



CYFRA 21-1 in BPE and MPE 

All 22 studies evaluated the CYFRA 21-1 level in 
MPE compared with BPE. Overall, the eligible stu- 
dies included 1653 MPE cases and 1011 BPE con- 
trols. Five case-control studies determined the 
CYFRA 21-1 level using ELISA, compared with sev- 
en and ten case-control studies that used IRMA and 
ECLA, respectively. The random-effect model and 
SMD were used to perform the meta-analysis. The 
results indicate that the weight of included studies 
ranged from 3.6% to 5.9%. The weight derived from 
SD can be used to evaluate the quality of referen- 
ces. The SMD of the CYFRA 21-1 level in MPE com- 
pared with BPE was 1.65 (95% CI = 1.48-1.82; test for 
heterogeneity = 67.19, p < 0.00001, 1 2 = 69%; test 
for overall effect: Z = 18.97, p < 0.00001) (Figure 2). 
There was a significant difference in the CYFRA 21-1 
level between the MPE and the BPE. The CYFRA 21-1 
level was significantly higher in MPE than that in 
BPE. In the following analysis of sensitivity, the indi- 
vidual exclusion of studies did not substantially 



Arch Med Sci 5, October / 2012 



759 



Rong Biaoxue, Yang Shuanying, Cai Xiguang, Zhang Wei, Li Wei 



Figure 2. Meta-analysis using a random-effect model for the SMD of the CYFRA21-1 level in BPE and MPE 



Study 


Malignant 




Benign 




Std. mean difference 


Std. mean difference 


nc ci iHcrrni in 


Mean 


SD 


Total 


Mean 


SD 


Total 


Weight 


IV, Random. 95% CI 


Year IV, Random. 95% CI 


Xiaofu, 1999 


92.58 


42.56 


68 


22.16 


8.69 


40 


4.5% 


2.04 [1.56, 2.52] 


1999 




Yijang, 1999 


21.5 


13.34 


30 


6.97 


4.52 


30 


3.9% 


144 [0.87, 2.01] 


1999 




Huoqlang, 2002 


55.34 


37.44 


156 


9.08 


7.54 


123 


5.9% 


162 [1.35, 1.89] 


2002 




Aizhen, 2003 


47.3 


18.2 


62 


14.4 


9.4 


38 


4.3% 


2.11 [1.61, 2.61] 


2003 


m 


Jianguo, 2003 


28.82 


13.77 


107 


14.95 


8.59 


69 


5.5% 


1.15 [0.82, 1.48] 


2003 




Wenfu, 2004 


65.3 


45.7 


40 


4.9 


5.3 


42 


4.2% 


1.86 [1.34, 2.38] 


2004 




Yalin, 2006 


63 


46 


32 


2 


1.3 


30 


3.7% 


182 [122, 2.42] 


2006 


| 


Yuseng, 2006 


73.1 


42.9 


63 


8.2 


2.6 


31 


4.3% 


1.83 [1.32, 2.33] 


2006 


B 


LianZhou, 2008 


20.1 


15.65 


30 


2.73 


1.71 


18 


3.5% 


1.37 [0.72, 2.02] 


2008 


B 


Guochen, 2008 


40.55 


23.85 


34 


12.31 


12.86 


30 


4.0% 


1.43 [0.88, 1.98] 


2008 


1 


Baoxiang, 2008 


46.38 


37.9 


54 


7.84 


4.37 


35 


4.6% 


1.29 [0.82, 175] 


2008 




Zikun, 2008 


9.6 


5.5 


170 


3.8 


2.5 


80 


5.8% 


1.22 [ 0.93, 1.50] 


2008 




Xilin, 2008 


38.87 


19.67 


34 


12.72 


11.06 


42 


4.2% 


1.67 [1.14, 2.20] 


2008 




Jiahe, 2008 


41.16 


31.93 


36 


7.61 


12.52 


20 


3.8% 


1.24 [0.64, 1.83] 


2008 




Fang, 2008 


39.14 


29.97 


78 


6.06 


7.54 


45 


5.0% 


1.35 [0.95, 1.76] 


2008 




Jin, 2009 


19.26 


15.34 


59 


2.87 


2.54 


48 


4.8% 


1.41 [0.98, 1.84] 


2009 




Jing, 2009 


35.67 


17.43 


40 


1.17 


0.45 


40 


3.6% 


2.77 [2.15, 3.39] 


2009 




Titan, 2010 


41.71 


23.87 


253 


3.56 


1.62 


36 


5.2% 


1.70 [1.32, 2.08] 


2010 




Yang, 2010 


27.98 


17.41 


65 


2.25 


1.78 


28 


4.3% 


1.74 [1.23, 2.26] 


2010 




Hongmei, 2010 


18.93 


8.45 


80 


2.09 


1.42 


50 


4.6% 


2.50 [2.03, 2.97] 


2010 




Feng, 2010 


5.31 


3.44 


76 


2.08 


1.65 


84 


5.5% 


1.21 [0.87, 1.55] 


2010 




Hua, 2010 


38.4 


22.4 


86 


2.7 


2.1 


52 


4.9% 


2.00 [1.58, 2.42] 


2010 




Total (95% CI) 






1653 






1011 


100.0% 


165 [148, 182] 






Heterogeneity: Tau 2 = 0.11, x 2 = 67.19, df = 21 (p < 0.00001); I 1 = 
Test for overall effect: Z = 18.97 (p < 0.00001) 


69% 




i 1 

-4 -2 

Malignant 


1 h 

3 2 4 

Benign 



modify the estimators, with SMD values varying 
between 1.15 and 2.77. 

CYFRA 21-1 in pleural effusion and serum 
in lung cancer patients 

Thirteen studies compared the CYFRA 21-1 levels 
between pleural effusion and serum in lung cancer 
patients, and the eligible studies included 717 cases. 
Similarly, the random-effect model and SMD were 
also employed to perform the meta-analysis. The 
results show that the weight of included studies 
ranged from 7.4% to 8%, indicating better consis- 
tency. The SMD of the CYFRA 21-1 level in pleural effu- 
sion compared with that in the serum of lung cancer 
patients was 1.10 (95% CI = 0.71-1.48; test for het- 
erogeneity = 134.19, p < 0.00001, 1 1 = 91%; test for 
overall effect: Z = 5.59, p < 0.00001) (Figure 3). 
There was a significant difference between the CYFRA 
21-1 level in pleural effusion and that in the serum. 
The CYFRA 21-1 level in the pleural effusion was sig- 
nificantly higher than that in the serum. In the 
analysis of sensitivity, the individual exclusion of 
studies did not substantially modify the estimators, 
with SMD values varying between -0.64 and 2.62. 

CYFRA 21-1 in pleural effusion between 
squamous cell lung cancer and 
adenocarcinoma 

Eight studies evaluated the CYFRA 21-1 level in 
the pleural effusion of SCC and adenocarcinoma 



patients. Overall, the eligible studies included 268 
SCC cases and 320 controls (adenocarcinoma 
patients). Five case-control studies determined the 
CYFRA 21-1 level using ECLA, whereas three case- 
control studies used IRMA The random-effect mod- 
el and SMD were used to perform the meta-analy- 
sis. The results indicate that the weight of included 
studies ranged from 9.1% to 16.2%. The SMD of the 
CYFRA 21-1 level in the pleural effusion of SCC 
patients compared with adenocarcinoma patients 
was 1.03 (95% CI = 0.64-1.42; test for heterogene- 
ity = 29.50, p = 0.0001, 1 2 = 76%; test for overall 
effect: Z = 5.15, p < 0.00001) (Figure 4). There was 
a significant difference between the CYFRA 21-1 
levels in the pleural effusion of SCC and adenocar- 
cinoma patients. The CYFRA 21-1 level in the pleu- 
ral effusion was higher in SCC patients than that 
in adenocarcinoma patients. In the analysis of sen- 
sitivity, the exclusion of studies individually did not 
substantially modify the estimators, with SMD val- 
ues varying between 0.31 and 2.37. 

Publication bias 

To ensure comparability, method comparison 
and bias evaluation must be performed when the 
same test is determined by different detecting sys- 
tems. The outcomes should include the uncertain- 
ty to provide reliable data for clinical diagnosis and 
treatment. The shape of the funnel in the funnel 
plot analysis of publication biases appeared to be 
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Figure 3. Meta-analysis using a random-effect model for the SMD of the CYFRA 21-1 level in pleural effusion and serum 
in lung cancer patients 



Study 


Pleural effusion 




Serum 






Std. mean difference 






Std. mean difference 




Mean 


SD 


Total 


Mean 


SD 


Total 


Weight 


IV, Random. 95% CI 


Year 




IV, Random. 95% CI 


Xiaofu, 1999 


92.58 


42.56 


68 


12.24 


7.26 


68 


7.6% 


2.62 [2.16, 3.08] 


1999 








Aizhen, 2003 


43.7 


18.2 


62 


13.3 


16.8 


62 


7.7% 


1.73 [1.31, 2.14] 


2003 






— „_ 


Wenfu, 2004 


65.3 


45.7 


40 


12.6 


6 


40 


7.4% 


160 [1.09, 2.11] 


2004 








Yalin, 2006 


63 


46 


32 


78.6 


10.5 


32 


7.4% 


-0.46 [-0.96, 0.04] 


2006 








Yuseng, 2006 


73.1 


42.9 


63 


28.4 


11.9 


63 


7.8% 


1.41 [1.02, 1.80] 


2006 








Jiahe, 2008 


41.16 


31.93 


36 


13.65 


29.03 


36 


7.5% 


0.89 [0.41, 1.38] 


2008 








Guochen, 2008 


40.55 


23.85 


34 


20.42 


17.7 


34 


7.4% 
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Figure 4. Meta-analysis using a random-effect model for the SMD of the CYFRA 21-1 level in pleural effusion between 
SCC and adenocarcinoma patients 
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approximately symmetrical (Figure 5 A-C). Howev- 
er, there was some uncertainty because the sym- 
metrical degrees were not satisfied. Egger's test is 
based on a linear regression of the standard normal 
deviation against its precision. In the present analy- 
sis, the inverse of the standard error is considered 
as the independent variable and the standardized 
estimate of the size effect as the dependent variable. 
The test results were as follows: t = 2.25, d/= 21, 
p = 0.063, for the CYFRA 21-1 level in MPE compared 
with BPE; t = 2.30, d/= 11, p = 0.075, for the CYFRA 
21-1 level between pleural effusion and serum in lung 
cancer patients; and t = 1.107, d/= 7, p = 0.305, for 
the CYFRA 21-1 level in pleural effusion in SCC 
patients compared with adenocarcinoma patients. 
Begg's test was also performed for the publication 
bias, and the results of Begg's test indicated the 
following: SD score was 35.46, and p = 0.185 for 
MPE compared with BPE. The fail-safe number sig- 
nifies the number of negative results necessary to 
invert the positive effect of studies, which had sta- 



tistical significance in the meta-analysis. The big- 
ger the fail-safe number is, the more studies with 
a negative result are needed, indicating the stabi- 
lity of the results of the meta-analysis. The fail-safe 
number was 4466, 914, and 121 for MPE versus BPE, 
pleural effusion versus serum, and SCC versus ade- 
nocarcinoma meta-analyses, respectively, at a 0.01 
level (Table II). These results are consistent with the 
standard of greater than five times the included- 
article number. Therefore, the Egger and Begg tests, 
as well as the fail-safe numbers, suggest that pub- 
lication biases may not have a significant influence 
on the results. 

Study characteristics of CYFRA 21-1 
for differential diagnosis 

Seventeen studies evaluated the CYFRA 21-1 level 
for the utility of this marker in the differential diag- 
nosis of MPE and BPE. The eligible studies included 
a total of 1771 MPE and BPE cases. Six case-control 
studies determined the CYFRA 21-1 level using ECLA, 
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Table II. The fail-safe number (NFs) of the three meta- 
analyses 
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Figure 5. Funnel plot of each meta-analysis performed. 
The CYFRA 21-1 level in BPE and MPE (A), in pleural 
effusion and serum in lung cancer patients (B), and 
in pleural effusion between SCC and adenocarcino- 
ma patients (C) 



whereas six and five other studies used IRMA and 
ELISA, respectively. However, the cutoff value was not 
provided by three studies [22, 28, 31]. The highest 
sensitivity and specificity were 94% and 100%, 
respectively, whereas the lowest were 49% and 
57%, respectively. The number of true positives, 
false negatives, true negatives, and false positives 
were extracted from each eligible study to perform 
the meta-analyses of the diagnostic test (Table III). 

Diagnostic accuracy 

The forest plot of the sensitivity and specificity of 
17 pleural CYFRA 21-1 assays in the differential diag- 
nosis of MPE and BPE are shown in Figure 6. The aver- 
age sample size of the included studies was 104 
(range: 48-250). The sensitivity ranged from 0.49 to 
0.92 (mean: 0.67; 95% CI: 0.64-0.70), whereas the 
specificity ranged from 0.57 to 1.00 (mean: 0.85; 



95% CI: 0.82-0.87). The PLR was 4.37 (95% CI: 3.42- 
5.58), the NLR was 0.35 (95% CI: 0.28-0.43), and the 
DOR was 15.4 (95% CI: 10.54-22.49). The x 2 values of 
sensitivity, specificity, PLR, NLR, and DOR were 
102.06, 43.19, 28.92, 67.90, and 28.82, respectively, 
with all p-values less than 0.05, indicating a signif- 
icant heterogeneity among studies. An SROC curve 
plot representing the true-positive against the fal- 
se-positive rates of individual studies was derived 
(Figure 7). Most studies had specificity estimates 
close to 1.00. The specificity estimates of 17 studies 
were 0.85. Only one study [33] showed a low speci- 
ficity of CYFRA 21-1 in the differential diagnosis of 
pleural effusions (< 0.60). By contrast, the sensitivity 
estimates were relatively low, and the sensitivity 
was less than 0.50 in only two studies [27, 37]. The 
maximum joint sensitivity and specificity was 0.81 
[standard error of the mean (SEM), 0.0167], where- 
as the area under the curve (AUC) was 0.8786 (SEM, 
0.0166), indicating that the level of the overall accu- 
racy was medium to high. 

Discussion 

The determination of tumor markers in pleural 
effusions has been proposed as an alternative, non- 
invasive way of diagnosing pleural malignancy. 
However, the use of these measurements in clini- 
cal practice remains controversial. The CYFRA 21-1 
assay, which detects a soluble fragment of cytoke- 
ratin 19 that is expressed by all histological types 
of lung cancer, is capable of detecting epithelial car- 
cinomas, especially SCC. CYFRA 21-1 has been ex- 
tensively evaluated in the setting of NSCLC [38, 39]. 
Studies on the diagnostic significance of the CYFRA 
21-1 level in pleural effusions in differentiating ma- 
lignant from benign lung disease found CYFRA 21-1 
to be a reliable marker. High CYFRA 21-1 levels in the 
effusion may also be caused by impaired lymphatic 
drainage or pleural seeding of the tumor. Given that 
50% of MPE is caused by lung cancer and that most 
advanced-stage patients of lung cancer will have 
this condition, some experts suggest that CYFRA 
21-1 may be a promising tumor marker in this field. 
This hypothesis is also supported by several studies 
[8, 12, 40, 41]. However, CYFRA 21-1 also presents 
various performances in different studies. Porcel er al. 
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Table III. Summary data from the 17 studies of the utility of CYFRA 21-1 in the differential diagnosis of MPE and BPE 

Study Number of patients Assay method Cut-off Sensitivity [%] Specificity [%] 

Yijiang, 1999 [16] 60 ELISA 14.23 ng/l 87 77 

Xiaofu, 1999 [19] 108 IRMA 48.23 ng/l 71 83 

Aizhen, 2003 [31] 100 IRMA Unknown 94 85 

Jianguo, 2003 [38] 176 ECLA 20 ug/l 63 86 

Wenfu, 2004 [33] 82 IRMA 15.5 ug/l 93 57 

Yalin, 2006 [20] 62 IRMA 15 ug/l 60 100 

Zikun, 2008 [22] 250 ELISA Unknown 61 86 

Lianzhou, 2008 [34] 48 ECLA 3.3 ug/l 80 83 

Jiahe, 2008 [23] 56 ECLA 20 ug/l 65 90 

Baoxiang, 2008 [24] 89 IRMA 3.3 ng/ml 81 91 

Xilin, 2008 [25] 76 ELISA 34.89 ng/ml 68 93 

Guochen, 2008 [26] 64 IRMA 25 ng/ml 79 83 

Fang, 2008 [27] 123 ECLA 4.74 ug/l 49 91 

Jin, 2009 [18] 107 ELISA 3.3 ng/ml 92 79 

Jing, 2009 [28] 80 ECLA Unknown 60 95 

Hongmei, 2010 [35] 130 ELISA 10 ng/ml 60 78 

Feng, 2010 [37] 160 ECLA 3.3 ng/ml 46 87 



[41] reported that in all 416 pleural effusion patients 
they studied, the sensitivity of CYFRA 21-1 was only 
22%, whereas specificity was 100%. Several studies 
have indicated otherwise [42, 43]. Considering na- 
tional, ethnic, and hereditary differences, the evalua- 
tion of CYFRA 21-1 in the Chinese population was 



reviewed in the present study to determine its sig- 
nificance for the Chinese population. 

All 22 studies evaluated the CYFRA 21-1 level in 
MPE compared with BPE. The STARD and QUADAS 
tools were chosen because they exhibited better 
validity and reliability evidence in a recently publi- 
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Figure 6. Forest plot of the estimates of sensitivity and specificity for CYFRA 21-1 assays in the differential diagnosis 
of pleural effusions. The point estimates of sensitivity and specificity from each study are shown as solid circles. Error 
bars are 95% CIs 
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Figure 7. SROC curves of CYFRA 21-1 assays in the dif- 
ferential diagnosis between MPE and BPE. Each solid cir- 
cle represents each study in the meta-analysis. The 
size of each study is indicated by the size of the solid 
circle. The weighted (solid line) regression SROC curves 
summarize the overall diagnostic accuracy 

shed systematic review that evaluated the quality 
and modifications of these tools [13, 14]. Address- 
ing statistical heterogeneity is one of the most 
important aspects of many systematic reviews. The 
interpretative problems depend on how substan- 
tial the heterogeneity is because this condition 
determines the extent to which it might influence 
the conclusions of the meta-analysis. Therefore, the 
quantification of the extent of heterogeneity among 
various studies is essential. All studies were care- 
fully reviewed, and included studies were confirmed 
to possess good clinical homogeneity. A random- 
effect model and SMD were used to combine all stu- 
dies, although they demonstrated some between- 
study heterogeneity. In the current meta-analysis, 
the SMD of the CYFRA 21-1 level in pleural effusion 
(MPE vs. BPE) in Chinese patients was 1.65 (95% CI: 
1.48-1.82), which was obtained from 22 studies of 
1653 MPE cases and 1011 BPE controls. The results 
imply that CYFRA 21-1 is a hazard prognostic factor 
for MPE. Higher CYFRA 21-1 was found in MPE than 
in BPE. Therefore, the higher the number of patients 
with lung cancer included in the increased CYFRA 
21-1 assay, the better is the test performance, as 
the present results show, which are consistent with 
other studies on the CYFRA 21-1 assay [44-46]. 

Thirteen studies compared the CYFRA 21-1 level 
between pleural effusion and serum in lung cancer 
patients. The SMD in the CYFRA 21-1 levels in pleu- 
ral effusion and serum in lung cancer patients was 
1.10 (95% CI: 0.71-1.48), indicating a significant dif- 
ference. The CYFRA 21-1 level was significantly higher 
in pleural effusion than that in serum, indicating 
that more CYFRA 21-1 was secreted to pleural effu- 
sion than to serum at the same time. In the pleu- 



ral effusion assay based on CYFRA 21-1, the reaso- 
ning efficiency seemed to be improved compared 
with serum and can be used in the differential diag- 
nosis of lung cancer. The research involving 343 
healthy persons, 474 patients with a benign disease, 
and 4440 patients with a malignant disease, 2453 
of whom suffer from NSCLC, has found that the 
sensitivity and specificity of CYFRA 21-1 in SCC are 
higher than other histological types of lung cancer 
[47]. A previous study has also reported the posi- 
tive rate of CYFRA 21-1 in SCLC compared with other 
type of lung cancers [48]. In the current meta-analy- 
sis, the results show that CYFRA 21-1 had a higher 
significance in SCC than in adenocarcinoma patients 
and indicated that this marker can improve the sen- 
sitivity, as well as accuracy, in the detection of SCC. 
Common findings suggest that pleural effusion con- 
centration of CYFRA 21-1 is suitable for use in the 
early diagnosis of SCC [49]. Several studies have 
found that the CYFRA 21-1 assay is a better tumor 
marker of MPE [50, 51]. The sensitivity of the CYFRA 
21-1 assay most likely depends on the prevalence 
of squamous cell malignancies in the studied pop- 
ulation. More studies on the diagnostic significance 
of the CYFRA 21-1 level in pleural effusions in diffe- 
rentiating malignant from benign lung disease 
[52, 53] have found that CYFRA 21-1 is a reliable mar- 
ker. The current research is consistent with those 
findings. 

Choosing an outcome measurement method is 
a crucial step in the evaluation of CYFRA 21-1 in dif- 
ferentiating MPE from BPE. In clinical practice, differ- 
ent measurement methods for the diagnosis of lung 
cancer are always employed to detect the CYFRA 
21-1 level. The present meta-analysis demonstrates 
that the concentration of pleural CYFRA 21-1 has 
high specificity (0.85; 95% CI: 0.82-0.87) and PLR 
(4.37; 95% CI: 3.42-5.58) for the differential diagno- 
sis of pleural effusions. The summary estimate of sen- 
sitivity, however, was only 0.67 (95% CI: 0.64-0.70). 
A PLR of 4.37 suggests that patients with MPE have 
a nearly fivefold higher chance of being positive for 
CYFRA 21-1 compared with patients with BPE. This 
ratio suggests a potential role of CYFRA 21-1 deter- 
mination in discerning the properties of pleural effu- 
sion. However, these tests maximize specificity at 
the cost of sensitivity, and this trade-off has signifi- 
cant clinical implications. CYFRA 21-1 has a relatively 
low sensitivity and NLR values that do not exclude 
BPE when a patient's pleural CYFRA 21-1 concen- 
tration is lower than the cutoff value. A negative 
test, therefore, does not signify the absence of malig- 
nancy, and patients with negative CYFRA 21-1 results 
have a chance of having malignancy. The DOR is an 
indicator of test accuracy [54] that combines the 
data of sensitivity and specificity into a single num- 
ber. Generally speaking, the DOR values range from 
0 to infinity, with higher DOR values showing high- 
er accuracy. In the current meta-analysis, the 
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mean DOR was 15.4, indicating that the CYFRA 21-1 
assay could be advantageous in the diagnosis of 
MPE. The definitive diagnosis of pleural effusion 
usually requires pleural biopsies of adequate size 
for histopathological analysis, ideally obtained by 
pleuroscopy. When malignancy is suspected on 
pleural cytology and/or pleural needle biopsy, a test 
with a good NLR for MPE would avoid diagnostic 
pleuroscopy. The present meta-analysis shows that 
the pleural CYFRA 21-1 assay is useful in the diffe- 
rential diagnosis of MPE and BPE. The SROC curve 
has been recommended to represent the perfor- 
mance of a diagnostic test, and the area under the 
SROC curve (AUC) is not only useful to summarize 
the curve but is also quite robust to heterogeneity 
[54, 55]. A previous study [56] has shown that to 
demonstrate excellent accuracy, the AUC should be 
in the region of 0.97 or above. An AUC of 0.93 to 

0. 96 is very good, whereas 0.75 to 0.92 is good. An 
AUC less than 0.75 can still be reasonable, but the 
test has obvious deficiencies in its diagnostic accu- 
racy. In the current analysis, the AUC of CYFRA 21-1 
was 0.87, which varied between 0.75 and 0.92. This 
result shows that the pleural fluid CYFRA 21-1 has 
good accuracy in terms of the differential diagno- 
sis of pleural effusion. Based on the present data, 
the authors believe that every patient with an unex- 
plained pleural effusion should undergo thoraco- 
centesis with CYFRA 21-1 evaluations. Patients with 
negative cytological examinations and positive 
CYFRA 21-1 levels should undergo further invasive 
procedures, and the final step should depend on 
the demonstration of positive cytology or biopsy of 
the pleura, resulting in management decisions. 
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